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- r/ie MAILING DATE of this communication appears on the cover sheet with the correspondence aMress - 
Period for Reply 



A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 )[3 Responsive to communication(s) filed on 12 April 2004 . 
2a)l3 This action is FINAL. 2b)n This action is non-final. 

3) 0 Since this application is in condition for allowance except for fomnal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G. 213. 

Disposition of Claims 

4) 13 Claim(s) 1-55 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) 13 Claim(s) 12,13.34.35A7A8,54 ar)d 55 is/are allowed. 

6) EI Claim(s) 7-71 74-33. 36-46. 49-53 is/are rejected. 
?)□ Claim(s) Is/are objected to. 

8) 0 Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10) 0 The drawing(s) filed on is/are: a)n accepted or b)n objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1.85(a). 
Replacement drawing sheet(s) including the coirection is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 

1 1) 0 The oath or declaration is objected to by the Examiner. Note the attached Office Action or fomn PTO-152. 

Priority under 35 U.S.C. § 119 

12) n Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 1 9(a)-(d) or (f). 
a)n All b)n Some * 0)0 None of: 

1 .□ Certified copies of the priority documents have been received. 

2. n Certified copies of the priority documents have been received in Application No. . 

3. D Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 



Attachment(s) 

1 ) □ Notice of References Cited (PTO-892) 4) Q Interview Summary (PTO-413) 

2) □ Notice of Draftsperson's Patent Drawing Review (PTO-948) Paper No(s)/Mail Date. 

3) □ Information Disclosure Statement(s) (PTO-1449 or PTO/SB/08) 5) □ Notice of Informal Patent Application {PTO-152) 

Paper No(syMall Date . 6) □ Other: . 
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DETAILED ACTION 



1 . Applicant's amendment of 4/1 2/04 has been considered in preparing this 
office action. 



2. Claims 1-11,1 4-33, 36-46, and 49-53 stand rejected under 35 

U.S.C. 102(a) as being anticipated by Engdahl. 

With respect to claim 1 , Engdahl teaches the claimed method, for a factory 
process comprising a plurality of tasks, to permit monitoring of the process, the method 
comprising displaying the factory process in real-time as a three-dimensional, free- 
camera, computer generated representation of the process as a whole, at column 2 line 
9 to column 3 line 24, the "free camera" being taught at the abstract, with the user being 
able to move within the virtual factory floor among the spatially linked objects; and 
selectively displaying each of the tasks in real-time as a three-dimensional, free- 
camera, computer generated representation of the respective task, at column 3 lines 3- 
8. 



Claim 2 further requires selectively displaying data representative of a status of 
the displayed process. Engdahl teaches this at column 6 line 66 to column 7 line 15. 
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Claim 3 further requires selectively displaying data representative of a status of 
one of the displayed tasks. Engdahl teaches this at column 7 lines 39-52. 

Claim 4 further requires selectively displaying data representative of a status a 
plurality of the displayed tasks. Engdahl teaches this at column 2 lines 22-43, with the 
claimed tasks corresponding to machines. 

Claim 5 further requires the process to have a controllable parameter and the 
method to include controlling the parameter of the factory process. Engdahl teaches 
this at column 6 line 66 to column 7 line 15. 

Claim 6 further requires one of the tasks to have a controllable parameter and 
the method to include controlling the controllable parameter of the task. Engdahl 
teaches this at column 6 line 66 to column 7 line 1 5. 

Claim 7 further requires a plurality of the tasks to have a controllable parameter 
and the method to include selectively controlling the controllable parameter of each of 
the tasks. Engdahl teaches this at column 6 line 66 to column 7 line 15. 

Claim 8 further requires one of the tasks to have a sub-task and the method to 
include selectively displaying the sub-task in real-time as a three-dimensional, free- 
camera, computer generated representation of the respective task. Engdahl teaches 
this at column 7 lines 17-28 with the sub-task being a physical movement of the 
machine, for example. 

Claim 9 further requires the sub-task to have a controllable parameter and the 
method to include controlling the controllable parameter of the sub-task. Engdahl 
teaches this at column 7 lines 17-28. 
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Claim 10 furtlier requires a plurality of the tasks to have a respective plurality of 
sub-tasks and the method to include selectively displaying the sub-tasks in real-time as 
a three-dimensional, free-camera, computer generated representation of the respective 
sub-tasks. Engdahl teaches this at column 7 lines 17-28. 

Claim 1 1 further requires each of the sub-tasks to have a controllable parameter 
and the method to include controlling the controllable parameter of the sub-tasks. 
Engdahl teaches this at column 7 lines 17-28. 

Claims 14-22 and 49-53 recite features corresponding to claims 1-11; thus, 
claims 14-22 and 49-53 are rejected using rationale presented above for respective 
features of claims 1-11. 

Claims 23-33 are similar to claims 1-1 1 but further require a computer readable 
medium. Engdahl teaches using a computer readable medium at columns 11-12. 

Claims 36-46 are similar to claims 1-1 1 but further require a system. Engdahl 
teaches this at column 1 1 . 

3. Claims 1 2-1 3, 34-35, 47-48, and 54-55 are allowed. 

4. Applicant's arguments filed 4/1 2/04 have been fully considered but they 

are not persuasive. 

In the remarks, the applicant argues that Engdahl fails to teach a "free camera", 
which permits an operator to monitor and view the virtual image of a factory process 
from effectively every orientation including zooming. However, Engdahl teaches 
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changing the viewpoint, at clainn 1 , and zooming at the first paragraph of column 7. 
Further, applicant argues that Engdahl does not describe the factory process as a 
whole as being monitored in real-time. However, the first paragraph at column 7 
teaches a watch tool which is used for measuring real-time occurrences in the factory 
environment as reflected in its virtual depiction. The virtual depiction corresponds to the 
claimed "computer generated representation of the process". Therefore, applicant's 
assertion that Engdahl fails to teach a free camera; and monitoring a factory process in 
real time, in incorrect. 

5. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of 
time policy as set forth in 37 CFR 1 .136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed unfil after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is nfiailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 
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6. Any inquiry concerning this communication or earlier communications from 
the examiner should be directed to Almis R Jankus whose telephone number Is 703- 
305-9795. The examiner can normally be reached on M-F, 8-5. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Mark Zimmerman can be reached on 703-305-9798. The fax phone number 
for the organization where this application or proceeding is assigned is 703-872-9306. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 
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